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1.  INTRODUCTION 


The  AFOSR  Grant  75-2777  was  in  effect  from  November  1,  1974  to  Hay  15  , 
1979.  It  had  as  its  main  objective  the  development  of  theory  and  techniques 
for  optimally  extracting  features  from  data  for  the  purpose  of  classifying 
these  data  with  the  least  error. 

The  above  goal  was  achieved  through  the  development  of  the  techniques 
and  ancillary  results  described  in  the  following  section.  These  develop¬ 
ments  are  suppported  by  the  documents  listed  in  Section  3.  Various  other 
activities  that  took  place  under  the  aegis  of  the  grant  are  described  in 
Section  4. 


2.  RESEARCH  RESULTS 

Both  statistical  and  nonstat ist  ical  approaches  to  the  problems  of 
feature  extraction,  dimensionality  reduction,  and  image  processing  were 
investigated.  They  are  briefly  summarized  in  the  following  subsections. 

2.1.  Statistical  Feature  Extraction 

Let  x  denote  a  data  vector,  to  be  classified,  belonging  to  a  n-dimen- 

sional  real  measure  space  Rn.  By  a  "feature"  of  x  we  mean  a  (linear  or 

nonlinear)  measurable  functional  cp . :  R°  -  rV  If  we  pick  or  construct 

m  features  cp . :  Rn  -♦  r\  i  =  1  ,  .  .  .  ,  m,  the  resulted  ^p  m=  col  (cp,,...,  cp 
i  l  Tm 

Rn  _  Rm  is  called  a  "feature  extraction  map"  and  the  resultant  space  Rm  a 
"feature  space."  Since  there  is  a  measure  (or  measures)  given  on  R° ,  there 
is  a  corresponding  measure  (or  measures)  on  the  feature  space  Rm  induced 
by  cp.  To  signal  this  fact  we  will  denote  the  measure  space  R™  byRn(co). 

One  of  the  fundamental  problems  that  we  investigated  during  the 


period  of  the  grant  was: 


-2- 


Problem  I.  Given  positive  integers  n  and  m  such  that  n  *>  m;  a  set  of 

measures  on  Rn  defined  ly  the  probability  density  functions  (likelihood 

functions)  f„  (x/H.)  conditioned  on  pattern  classes  H.,  j  =  1 . H, 

x  J  J 

which  are  known  or  estimated  from  a  set  of  samples;  a  set  of  prior  proba- 

bil'Mes  P.  for  the  pattern  classes  H.,  j  =  I,...,  M;  and  a  class  g  of 
J  J 

admiss  ible  feature  extraction  maps  cp:  Rn  Rm(cp)  ;  find  a  cp  which  minimizes 
the  Bayes  risk  (probability  of  mi  sc  1  ass  i  f  icat  ion)  Q(cp)  in  the  feature 
space  Rm(cp)  over  all  cp  € 

A  nonlinear  programming  approach  f 1  ]  [4 ]  was  used  in  formulating  this 
problem  mathematically,  and  the  ensuing  algorithms  for  the  design  of  cp 
were  of  the  Fletcher-Powel 1  type. 

The  case  in  which  the  probability  density  functions  f  (x/H.)  are  normal 

x  J 

and  the  class  $  is  the  class  of  linear  transformations.,  was  completely 

solved,  and  tested  [2]  [3]  on  Cl  flight  line  data  and  LANDSAT  data  provided 

by  the  NASA  personnel  from  the  Johnson  Space  Center. 

The  qeneral  case  in  which  fY  (x/H.)  are  not  necessarily  normal  and  $ 

A  J 

is  a  general  class  of  nonlinear  (not  necessarily  linear)  transformations 
was  investigated  in  detail  in  [5], 

Specifically,  the  following  results  were  developed  in  [5]:  (I)  Based 

on  the  training  samples  of  the  pattern  classes,  the  construction  of  expres¬ 
sions  for  Q.(cp)  and  a  suitable  estimator  for  Q(cp)  ;  (II)  a  study  of  errors 
involved  in  estimating  Q(cp)  ;  (III)  characterization  of  families  $  of 
transformat  ionsep;  (IV)  derivation  of  conditions  for  an  optimal  cp;  and 
(V)  techniques  for  finding  an  optimal  cp. 

2.2.  Adaptive  Estimator  of  Probability  Density  Functions 

The  two  basic  entities  entering  in  the  statistical  feature  extraction 
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analysis,  referred  to  in  the  preceding  section,  are  the  probability  den¬ 
sity  function  (likelihood  function)  and  the  Bayes  risk.  New  accurate  and 
efficient  ways  of  estimating  these  entities  were  developed.  In  this  sub¬ 
section  we  briefly  describe  our  new  probability  density  function  estimator 
and  in  the  following  subsection,  our  new  Gayes  risk  estimators. 

Specifically,  our  objective  in  [7]  was  to  construct  an  adaptive 
orthogonal  series  estimator  for  a  probability  density  function  fY(x)  asso- 
dated  with  a  real  random  variable  X  (From  now  on,  for  simplicity  in 
notation,  we  will  drop  the  subscript  in  fv(x)  ). 

So,  given  a  sample  set  X,,...,  X  of  independent  identically  distri- 

I  n 

bu ted  real-valued  random  variables,  each  with  the  unknown  probability 
density  function  f(-),  the  problem  considered  in  [7]  was  to  estimate  f 
from  the ‘sample  set.  The  function  f  was  assumed  to  be  in  L^a.t); 
f  was  not  assumed  to  be  in  any  parametric  family.  We  constructed  an 
adaptive  "two-pass"  solution  to  the  problem:  In  a  pre-nrocess i ng  step 
(the  first  pass),  a  preliminary  rough  estimate  of  f  was  obtained  by  means 
of  a  standard  orthogonal-series  estimator.  In  the  second  pass,  the  pre¬ 
liminary  estimate  was  used  to  transform  the  orthogonal  series.  The  new, 
transformed  orthogonal  series  was  then  used  to  obtain  the  final  estimate. 
We  established  consistency  of  the  estimator  and  derived  asymptotic  (large 
sample  set)  estimates  of  the  bias  and  variance.  It  was  shown  that  the 
adaptive  estimator  offers  reduced  bias  (better  solution)  in  comparison  to 
the  conventional  orthogonal  series  estimator.  Computer  simulations  were 
presented  which  demonstrate  the  small  sample  set  behavior.  A  case  study 
of  a  bimodal  density  confirmed  the  theoretical  conclusions. 


j 
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2.3.  Computationally  Efficient  Esc imators for  che  Bayes  Risk 

A  computationally  efficient  estimator  for  the  Bayes  risk  is  one  v;hich 
achieves  a  desired  accuracy  with  a  minimum  of  computation.  In  many  problems, 
for  example  speech  recognition,  point  evaluations  of  the  class  conditional 
densities  are  computationally  costly.  Density  evaluations  are  the  single 
most  important  factor  contributing  to  the  computational  effort  in  Bayes 
risk  estimation,  thus  the  amount  of  computation  required  by  a  Bayes  risk 
estimator  is  defined  as  the  average  number  of  conditional  density  evaluations 
it  performs.  The  accuracy  of  a  risk  estimator  is  defined  by  its  variance. 

Existing  estimators  for  the  Bayes  risk,  namely  the  error  count  esti¬ 
mator  and  the  posterior  estimator,  requ  i  re  for  each  sample  Xj ,  j=l,2...N, 

evaluation  of  the  class  conditional  density  f  (X.)  for  each  class 

m  j 

m=l,2...M,  a  total  of  N*M  density  evaluations.  For  problems  such  as  speech 

recognition,  where  the  number  of  classes  M  is  large  and  density  evaluations 

costly,  these  estimators  are  impractical  from  a  computational  aspect. 

A  new  class  of  estimators  of  the  general  form  Q.(T)  was  proposed  in 

[8].  In  [8l  an  estimator  Q(T)  is  defined  by  associating  with  each  class 

m  a  subset  T  of  the  M  classes.  For  two  classes,  only  the  error  count  and 
m 

posterior  estimators  belong  to  this  class.  For  more  than  two  classes, 
several  new  estimators  for  the  Bayes  risk  are  included. 

Specifically,  the  following  results  are  presented  in  [8],  Estimators 
requiring  fewer  density  evaluations  are  derived  from  the  class  of  esti¬ 
mators  of  the  general  form  Q(T)  as  follows.  A  scalar  parameter  a  deter¬ 
mines  the  sets  T  (a)  of  classes  that  are  "a-c lose"  to  each  class  n, 
m 

A  A 

hence  an  estimator  (Ho)  of  the  general  form  Q(T).  As  a  varies,  the  sets 
T,(a)  , . . . ,TM(s)  vary  and  a  family  (Q(a)  :  0  a  <  a  )  of  risk  estimators 
is  achieved.  Each  estimator  in  the  family  is  characterized  by  the  average 
number  of  density  evaluations  it  requires  and  its  variance. 
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The  optimal  estimator  from  the  family  {Q.(o)  :  0  <;  a  <  a  1  is  de- 
r  max 

fined  as  that  estimator  with  maximum  computational  efficiency,  where  the 
computational  efficiency  of  an  estimator  is  the  inverse  of  the  product  of 
the  average  number  of  density  evaluations  it  requires  and  its  variance. 

The  optimal  estimator  requires  the  least  amount  of  computation  to  achieve 
a  given  accuracy,  or,  symmetrically,  achieves  the  greatest  accuracy  with 
a  minimum  of  computation. 

In  practice,  the  true  optimal  estimator  cannot  be  determined  since 
this  would  in  effect  require  knowledge  of  the  true  risk  Q.  Thus  a  tech¬ 
nique  whereby  the  first  n  of  the  total  N  samples  are  used  to  approximate 
the  optimal  estimator  is  proposed.  The  n  samples  should  contain  enough 
information  on  the  closeness  of  the  classes  to  determine  an  almost  optimal 
estimator.  The  last  N-n  samples  are  used  in  the  approximate  optimal  esti¬ 
mator  to  obtain  an  accurate  estimate  of  the  risk  with  a  minimum  of  compu- 
ta  t i on . 

2.4.  Structure  Preserving  Dimensionality  Reduction 

A  substantial  effort  was  devoted  to  the  development  of  new  schemes 
for  dimensionality  reduction  by  means  of  structure  preserving  nonlinear 
maps.  The  results  obtained  are  described  in  [9],  [101,  and  [111.  Note 
that  this  may  be  considered  as  a  geometric  approach  to  feature  extraction. 

Problem  2.  Given  a  set  of  data  vectors  X  =  (X^,...,  X^}  ,  where  each 
X.  6  Rn,  find  a  set  of  vectors  Y  =  (Yj,...,  Y^],  where  Y.  €  Rm.  (where  n 
is  an  integer  satisfying  1  <  m  <  n)  in  such  a  way  that  the  "structure" 
present  in  X  is  optimally  preserved  under  the  transformation  from  X  to  Y, 
that  is,  the  mapping  from  X  to  Y  should  take  place  with  the  least  de¬ 
gradation  in  the  data  structure. 
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To  solve  the  above  problem,  J.  W.  Sammon*  proposed  his  well-known 

"nonlinear  mapping  algorithm"  in  which  the  set  Y  is  selected  so  that  the 

following  criterion  function  is  minimized 

*  2 

,  N  (d..  -  d..) 

T=  “V-1 

Kj  Ij 


where 


d  =  Ed. 


'J 


«j 


d. .  =  X.  -  X. 
jj  11  i  j 


d’.\  =  I |Y.  -  Y. 
U  1  J 


and  |1  .  M  denotes  the  Euclidian  norm  in  the  underlying  space. 

Sammon's  algorithm  considers  all  points  in  the  set  Y  in  the  optimization 
procedure  and  hence  its  computat ional  feasibility  is  limited  by  the  number 
of  points  in  Y.  Also,  there  are  important  features  that  ought  to  be  consi¬ 
dered  other  than  the  above  interpoint  distance  considered  by  Sammon. 

Our  contributions  [9]  -  [II]  to  the  solution  of  Problem  2  outlined 
below  are  oriented  toward  removing  the  above  limitations  of  Sammon's  pro¬ 
cedure  and  in  fact  extending  it  as  indicated. 

(I)  In  [9]  and  [ICj  we  extended  Sammon's  procedure  by  constructing 
criterion  functions  which  embody  not  only  topological  cons iderat ions  (such 
as  interpoint  distances)  but  also  certain  graph  theoretical  considerations 


J.  W.  Sammon,  "A  Nonlinear  Mapping  for  Data  Structure  Analysis," 
IEEE  Trans,  on  Computers,  Vol.  C - 1 8 ,  pp,  401-409,  May  1969. 
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(such  as  the  minima!  spanning  tree,  maximally  complete  subgraphs,  incon¬ 
sistent  edges,  and  diameter  edges).  Our  algorithm  is  hierarchical  in 
nature  and  offers  considerable  savings  in  terms  of  computer  computation 
and  storage  requirements. 

(II)  Considering  the  set  X  mentioned  above  as  a  "training  set,"  we 
developed  techniques  for  mapping  new  data  points  by  ext raDO 1  a t ion .  This 
was  done  based  on  piecewise  linear  interpolation  in  TlOl  and  by  a  K  - 
nearest  neighbor  rule  in  [ 1 1 ] . 

(III)  In  [11],  the  dimensionality  reducing  nonlinear  mapping  tech¬ 
niques  mentioned  above  were  applied  with  considerable  success  to  the 
problem  of  discrimination  of  seven  sleep  stages  from  the  eight  lead 
human  electroencephalogram  (EEG). 

2,5.  Oil  Spill  Identification 

In  work  jointly  sponsored  by  the  AFOSR  Contract  75-2777  and  the  U.S. 
Coast  Guard  (Dept,  of  Transportation-)  contract  DOT-CG-8 1  -75- 1 383 ,  the  use 
of  a  pattern  recognition  approach  for  typing  and  identification  of  oil 
spills  was  investigated.  S.A.  Starks  and  M.L.  Curtis  worked  on  the 
project . 

The  first  phase  of  this  study  involved  generating  an  algorithm  for 
giving  a  probability  that  two  oil  samples  (the  suspect  sample  and  the 
spill  sample)  are  the  same.  This  was  done  using  f'uorescence  spectra  of 
some  230  oil  samples  furnished  by  the  Coast  Guard  Research  and  Development 
Center,  Groton,  Connecticut.  These  included  crude  oils,  heating  oils,  and 
lubric at ing  oils. 

The  second  phase  of  the  above  study  involved  the  independence  of 
infrared  and  fluorescence  spectra  of  oils.  In  this  phase,  infrared  and 
fluorescence  spectra  of  30  oil  sanples  were  used. 
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The  rather  satisfactory  results  obtained  are  described  in  [12]  -  [  14  ] . 
2.6.  Digital  Image  Processing 

Three  projects  in  digital  image  processing,  described  under  2.6.1 
through  2.6.3  below,  were  successfully  completed.  The  Principal  Investi¬ 
gator  was  also  very  heavily  involved  in  obtaining  funds  from  the  National 
Science  Foundation  and  from  the  University  to  set  up  a  "Signal  Analysis 
and  Image  Processing  Facility"  at  Rice,  where  the  AFOSR  research  work 
described  below  might  be  carried  out.  This  objective  was  achieved  and 
such  a  facility  created  as  indicated  in  2.6.4  below. 

2.0.  I .  Image  Restoration  Based  or.  Psychovisual  Modeling 

A  member  of  our  group  Mr.  G.  Leigh  Anderson  collaboratec  with  Dr.  A. 

N.  Netravali  of  Bell  Laboratories,  Holmdel,  N.J.  in  developing  a  technique 
for  digital  image  restoration  which  exploits  the  psychovisual  model  of 
masking.  Additive  noise  is  less  visible  in  a  region  of  the  image  contain¬ 
ing  large  brightness  changes  than  in  a  region  with  little  spatial  detail; 
the  rapidly  varying  brightness  "masks"  the  eye's  response  to  noise.  Sub¬ 
jective  measurements  were  made  to  determine  the  psychovisuai  visibility 
of  noise  as  a  function  of  spatial  brightness  changes.  Then  filtc  s  were 
designed  which  smoothed  the  image  under  the  control  of  the  exper imenta 1 ly 
determined  noise  visibility  function.  The  results  were  very  good;  most  of 
the  visible  noise  was  removed  without  appreciably  blurring  the  image.  The 
results  appear  in  reference  [15]. 

2.6.2.  Image  Restoration  by  Adaptive  Kalman  Filtering 

As  a  sequel  to  the  project  just  described,  we  successfully  embarked 
into  another  research  study,  namely  the  development  of  an  adaptive  non- 
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iinear  Kaiman-type  filter  for  the  restoration  of  two-d imens ional  images 
degraded  by  general  image  formation  system  degradations  and  additive  white 
noise.  A  vector  difference  equation  model  was  used  to  model  the  degrada¬ 
tion  process.  The  object  plane  distribution  function  was  partitioned 
into  disjoint  regions  based  on  the  amount  of  spatial  activity  in  the  imane, 
and  difference  equation  models  were  used  to  characterize  the  object  plane 
distribution  function. 

The  results  are  described  in  [  1 6 1 .  In  this  reference,  it  is  shown 
that  each  of  the  above  regions  can  be  unqiuely  characterized  by  their 
second  order  statistics.  The  autocorrelation  function  for  each  regie,  is 
then  used  to  determine  the  coefficients  of  the  difference  equation  model 
for  each  region.  Recursive  estimation  techniques  are  applied  to  a  compo¬ 
site  difference  equation  model. 

If  tne  images  are  to  be  restored  for  human  viewing  it  is  desirable 

to  account  for  the  response  of  the  human  visual  system  as  part  of  the 

2 

receiver  characteristics.  This  is  done  by  weighting  the  variance  z  of 
the  additive  noise  by  a  visibility  function,  where  the  visibility  function 
is  a  subjective  measure  of  the  visibility  of  additive  noise  in  an  image 
by  the  human  visual  system.  As  a  consequence,  the  resulting  effective 
variance  depends  nonlinearly  on  the  state. 

Two  additional  features  are  added  to  the  new  restoration  filter  to 
solve  problems  arising  in  the  implementation  phase.  A  nearest  neighbor 
algorithm  is  proposed  for  the  selection  of  a  previously  processed  pixel 
for  providing  the  previous  state  vector  for  the  state  of  pixel  (.  i .  j ) . 
Secondly,  a  two-dimensional  interpolation  scheme  is  proposed  to  improve 
the  estimates  of  the  initial  states  for  each  region. 


-10- 


2.6.3.  Variable  Length  Chain  Coding  of  Contours 

Coding  may  be  considered  to  be  a  form  of  feature  extraction  and 
dimensionality  reduction. 

As  an  extension  of  ordinary  chain  coding  we  investigated  two  new 
chain  coding  schemes  in  which  the  length  of  the  link  in  the  chain  was 
variable.  Details  on  the  results  obtained  are  given  in  [17].  A  specific 
application  of  these  schemes  to  template  matching  was  made.  Experimental 
results  showed  that  template  matching  using  the  schemes  developed  by  us 
for  representation  of  contours  performed  much  faster  than  the  ones  by 
conventional  techniques. 

In  the  above  study,  a  cluster  display  system  [2!]  was  also  developed. 

2.6.4.  Signal  Processing  and  Pattern  Analysis  Facility 

Research  work  done  under  the  AFOSR  grant  75-2777,  inspired  and  motivated 
the  Principal  Investigator  to  help  sec  up  at  Rice  University  a  Signal 
Processing  and  Pattern  Analysis  Facility.  Such  a  facility  was  created  in 
early  1979  with  funds  received  from  the  National  Science  Foundation  and 
Rice  University.  It  has  as  its  main  elements  a  DEC  PDP-11/55  computer  with 
several  accessories  and  a  GENISCO  Computers.  Inc.  GCT-3000  Digital  Display 
System.  This  system  is  a  programmable,  raster  scan  display  with  a  spatial 
resolution  of  512  by  512  pixels  and  a  color  resolution  of  256  colors  (out  of 
4096  possible  colors)  or  an  intensity  resolution  of  256  gray-levels. 

The  above  system  was  used  in  the  research  reported  under  2.6.2. 


H.  Freeman,  "On  the  Encoding  of  Arbitrary  Geometric  Conf  igurat ions" 
IRE  Trans,  on  Elec.  Comp,,  EC-10,  260-268,  June  1961. 
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[1]  R.  J.P.  de  Figueiredo,  "Optimal  linear  and  Nonlinear  Feature 
Extraction  Based  on  the  Increased  Risk  of  Misc lass i f icat ion Proc.  of  the 
2nd.  Joint  Intnl.  Conference  on  Pattern  Recognition,  Copenhagen,  Denmark, 
1974. 

[2]  S.  A.  Starks,  R.  J.P.  de  Figueiredo,  and  D.  L.  Van  Rooy ,  "An 
Algorithm  for  Optimal  Single  Linear  Feature  Extraction  from  Several 
Gaussian  Pattern  Classes,"  Intnl.  Journal  of  Computer  and  Information 
Sciences,  vol.  6,  No.  1,  pp,  41-54,  March  1977. 

[3]  R.  J.P.  de  Figueiredo,  K.  C.  Pau,  S.  A.  Starks,  and  D.  L.  Van 
Rooy ,  "An  Algorithm  for  Extraction  of  More  than  one  Optimal  Linear  Feature 
from  Several  Gaussian  Pattern  Classes,"  P’~oc.  of  the  Third  Intnl.  Joint 

Conf,  on  Pattern  Recognition,  Coronado.  CA. ,  November.  1976;  also, 
accepted  for  publication  in  the  IEEE  Trans,  on  Automatic  Control. 

[4]  R.  J.P.  de  Figueiredo,  "Design  of  Optimal  Feature  Extractors 
by  Mathematical  Programming  Techniques,"  in  the  book  Pattern  Recognition 
and  Artificial  Intelligence,  edited  by  C.  H,  Chen,  Academic  Press,  1977. 

[5]  A.D.  Sagar  and  R.  J.P.  de  Figueiredo,  "A  Methodology  for  Optimal 
Nonlinear  Feature  Extraction  in  Statistical  Pattern  Recognition,"  Rice 
University  Technical  Report  7711,  to  be  submitted  for  publication. 
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[6]  R.  J,P.  de  Figueiredo,  “Feature  Extraction  Techniques  for 
Classification  and  Identification  of  Spectral  Signatures,"  in  the  Proc . 
of  the  1976  Milwaukee  Symposium  on  Automatic  Computation  and  Control, 
pp.  303-304,  1976. 

[7]  G.  L.  Anderson  and  R.  J.P.  de  Figueiredo,  “An  Adaptive  Orthogonal 
Series  Estimator  for  Probability  Density  Functions,"  to  appear  in  the 
March  1980  issue  of  the  Anna  Is  of  Statistics. 

[8]  t.  D.  Wilcox  and  R.  J.P.  de  Figueiredo,  “Computationally  Effi¬ 
cient  Estimators  for  the  Bayes  Risk,"  Rice  University  Technical  Report 
7804,  May  1978. 

[9]  S.  A.  Starks  and  R.  J.P.  de  Figueiredo,  “A  New  Approach  to 
Structure  Preserving  Feature  Extraction,"  Proc.  of  the  1977  Conference  on 
Information  Sciences  and  Systems,  Johns  Hopkins  Univ.,  Baltimore,  Md . , 

April  1977. 

[10]  S . A.  Starks  and  R.J.P.  de  Figueiredo,  "An  Algorithm  for  Optimal 
Nonlinear  Structure  Preserving  Feature  Extraction",  presented  at  t-he  1977 
IEEE  Internat ional  Symposium  on  Information  Theory,  Cornell  University, 
Ithaca,  N.Y.,  October  1977;  submitted  to  the  IEEE  Trans,  on  Computers. 

[11]  R.  C.  Pruett  and  R.  J.P.  de  Figueiredo,  "A  Nonlinear  Mapping 
Approach  to  Discrimination  of  Sleep  Stages  from  the  Human  Electroencepha¬ 
logram,"  Rice  University  Technical  Report  EE  7902  ;  May  1979, 

[12]  S.  A.  Starks  and  M.  L.  Curtis,  "Use  of  Ultraviolet  Spectros¬ 
copy  in  Oil  Spill  Identification,"  Proc  of  the  Twenty-Seventh  Pittsburgh 
Conference  on  Analytical  Chemistry  and  Applied  Spectroscopy,  March  1976. 

[13]  J.  S.  Mattson,  C.  S.  Mattson,  M.  J.  Spencer,  and  S.  A.  Starks, 
"Multivariate  Statistical  Approach  to  Fingerprinting  of  Oils  by  Infrared 
Spectroscopy,"  Anal.  Chem. ,  49,  297-302,  1977. 
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[14]  M.  L.  Curtis,  "Use  of  Pattern  Recognition  Techniques  for 
Typing  and  Identification  of  Oil  Spills,"  Technical  Report  No.  CG-D-38-77, 
U.S.  Coast  Guard  R  &  D  Center,  April  1977. 

[15]  G.  L.  Anderson  and  A.  N.  Netravali,  "Image  Restoration  Based 
on  a  Subjective  Criterion,"  IEEE  Trans  on  Systems,  Man,  &  Cybernetics. 
CMS-6(12),  845-853,  December  1976. 

[16]  Sarah  A.  Rajala  and  R.  J.P.  de  Figueiredo,  "Adaptive  Nonlinear 
Image  Restoration  by  a  Modified  Kalman  Filtering  Approach,"  Rice  Univ. 
Technical  Report  EE-7904,  June  1979.  Submitted  to  IEEE  Trans.  On  ASSP. 

[17]  K.  C.  Pau  and  R.  J.P.  cie  Figueiredo,  "Variable  Length  Chain 
Coding  with  App 1 icat i ors ,"  R ice  University  Technical  Report  EE-7903, 

May  1979,  to  be  submitted  for  publication. 

[18]  A.  N.  Netravali  and  R.  J.P.  de  Figueiredo,  "On  a  Class  of 
Minimum  E  ergy  Controls  Related  to  Spline  Functions,"  IEEE  Trans,  on 
Automat ic  Control ,  AC -21,  October,  1976. 

[19]  R.J.P.  de  Figueiredo,  "An  Interpolat ive  and  Smoothing  Theory 
for  Hardware  Implementation  of  Feature  Extraction",  Rice  University 
Technical  Report  EE-7710,  June  1977. 

[20]  R.  J.  P.  de  Figueiredo,  "Approaches  to  the  Formulation  and 
Solution  of  Nonlinear  Inverse  Problems",  Rice  University  Technical 
Report  EE-7810,  November,  1978. 

[21]  K.  C.  Pau,  "An  Interactive  Cluster  Display  System",  Rice 
University  Technical  Report  EE  7709,  May,  1977. 


4.  OTHER  ACTIVITIES 

Professor  de  Figueiredo  attended  and  presented  invited  and  contri¬ 
buted  papers  at  various  meetings  during  the  tenure  of  the  AFOSR  Grant 
75-2777,  Of  these,  special  mention  may  be  made  of  the  following:  He 
organized  and  co-chaired  the  main  panel  discussion  session  at  the  Joint 
Workshop  on  Pattern  Recognition  and  Artificial  Intelligence  held  in 
Hyannis,  Massachusetts  on  June  1-3,  1976.  He  was  a  member  of  the  IEEE 
delegation  to  the  1977  USSR  Popov  Society  meeting  in  Moscow. 

Also,  over  the  entire  period  of  the  AFOSR  Grant  75-2777,  Professor 
de  Figueiredo  had  many  fruitful  technical  discussions  with  members  of 
the  Pattern  Recognition  Group  of  the  Rome  Air  Development  Center  (RADC), 
especially  with  Mr.  H.  E.  Webb  and  J.  Faust.  He  participated  in  projects 
sponsored  by  RADC ,  monitored  by  Mr.  H.  Webb.  Two  of  the  reports  that 
resulted  from  this  activity  are  listed  as  references  [19]  and  [20]  in 
Section  3.  Reference  [18]  was  presented  at  a  special  RADC  one-day  meet¬ 
ing,  held  in  New  York  City  in  November  of  1978,  on  "Signal  Restoration  and 
1 1 1  Posed  Problems . " 

The  grant  research  was  enhanced  by  the  visit  made  to  our  group  by 
Professor  Marian  Mazur,  member  of  the  Polish  Academy  of  Sciences  and 
a  noted  cyt>ernet  ic  ist ,  in  the  months  of  January  and  February  of  1977. 
Professor  Mazur  had  extensive  discussions  with  the  Principal  Investigator 
on  a  theoretical  framework  for  the  description  of  the  structure  and 
functioning  of  natural  human  intelligence,  and  on  possible  application 
of  such  a  framework  to  the  solution  of  pattern  recognition  by  machines. 
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Final  1  y ,  with  the  full  or  partial  support  from  the  AFOSR  grant, 
six  Ph.O.  dissertations  (of  G.  L.  Anderson,  L.D. Wilcox,  S. A. Starks, 
A.D.Sagar,  S.A.Rajala,  and  R.C, Pruett)  and  two  Master  of  Sciences  theses 
(of  K.C.Pau  and  S.A.Rajala)  were  completed,  and  four  Ph.D.  dissertations 
now  in  progress  (of  S.Fogel,  C.L.Hu,  T. J. Brzustowicz ,  and  T.C.Chen) 
were  begun. 
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